Early Literacy in Massachusetts: 
Part 1. Findings from the Massachusetts 
Educator Preparation Program Early 
(Sali fel atexeleM-lalem =tl=lanl=laie-lavm=eleler-lalela 
Program Core Course Review 


Region 1 Comprehensive Center (R1CC), 
Massachusetts Department of Elementary and Secondary Education (DESE) 


May 18, 2021 


CONETWORK WY) Sm seesnarin 


Comprehensive Center Network Massachusetts | Vermont 


Early Literacy in Massachusetts: 


Part 1. Findings from the Massachusetts Educator Preparation 
Program Early Childhood and Elementary Education Program 
Core Course 


Region 1 Comprehensive Center 
Massachusetts Department of Elementary and Secondary Education (DESE) 


May 18, 2021 


CONETWORK |) iisine new Hampshire 


Comprehensive Center Network Massachusetts | Vermont 


Contents 


Page 

EX@CULIVE SUIMIMAPY sisescctesaccsvausssieelasseuscauadeseedesdetateusvadecinade te cacsgeas Meade catasdadeaasapaterbasaadecdeatectawadkesse 1 
WARFOGDU CUO M5; cs3esedssssesceseedesbegassdbeas tedesesgsdedgads Sy sbsbessadl dead dasedoansbdens ey snseessssdiaas obaasbedadvedade Wenieeosinees 3 
Educator Preparation Program Course Review Objectives and QUESTIONS..........cccccccceecceeeeeeeeeeeees 4 
METRO COMO BY acateaiecadunacns ce daatatiatacuiecnncsamenuad anata suedetudsaanaads sania suena eataueeaeuate ranean needa nat eadanvarctaiads 4 

RECHUITIMGME GMC Sane caipeteitertst elise iconic ceuadeccciceiiecelaee ae dpane Aestaleantudeehaleed Mae araeietaaitesncees 5 

REVIQW PLOGESS ei.sc3scicctecakiaccced SeediG ecesedacthedaaodaneeechedh chabic elie achacaadbcnebtdeas Sands onedieadeaaseenebels 6 
PHEVCINES saga scntatardatanduvaneiencdenataiecedcuassd ansacasuqconueidaneidvncsauiascstenaadenst uaciaantaeeanseanatwaemeadinatnvaeaentans 7 

To what extent are evidence-based practices in reading and writing instruction 

represented within program syllabi from the participating EPPS?...........:ccccccceeessssssttteeeeeeeeeeees 8 

Do syllabi vary in the intensity and levels of practice-based opportunities associated 

with the evidence-based practices in reading and writing instruction? If so, how do 

TIDY WANG © eesiecnaaacacyaacendicngaasaiceiednant dnaaiaasistducnabcsaansnnaaads aan cniaildasguadesaccesacenqaadaaba duaeidutiatavaaaecancaned 10 
GOMEIUISIONS cose se ee cee tece tcc tothe cetacs sasde te aus ance ntnste ne sansa sees shetiens aus sag oewec Se tacadttes eate ae ics Seasons tees 16 
REPEPEN COS 22325 e93es0do00hes20s ebb ssicsdsneddaaeidasecendodaeds beh vsiis¥ deaheeasodanssboeagebda sou daaddsaseddasd Sdese¥dlened hidesses 17 
PRIN cece eco sd cto eadeieta lene ty spnreneidiea ut aeeulee Ce cbieenmuindleteedabececteananemecubdvann la lpaisleiecaxeueapeecalaents 20 


CONETWORK YY) Sm sectanri 


Comprehensive Center Network Massachusetts Vermont 


Exhibits 


Page 
Exhibit 1. Characteristics of the Nine Participating EPPS ..............cescssssseeeeeeceseeseeneeeeeeeeeeeeseeeaaaes 5 
Exhibit 2. Essential Components of the IC Reading Rubric Represented in the EPPs’ Syllabi............. 8 
Exhibit 3. Essential Components of the IC Reading Rubric Across the EPPS ...........::ssscccccceeeeeeeeneees 9 
Exhibit 4. Levels of Knowledge Building and Application on the Essential Components of 
Cie: IC Reali UG stccseesigecse ty stents balescaau Stacie teekieenetccutyeortmnereleanesntelibiaenaiie teen ieedomebeneaaldunels 11 
Exhibit 5. Essential Components of the IC Writing Rubric Represented in the EPPs’ Syllabi ......... 12 
Exhibit 6. Essential Components of the IC Writing Rubric Across the EPPS..............:ssssseeeeeeeeeeeeees 13 
Exhibit 7. Levels of Knowledge Building and Application on the 10 Essential Components 
OT TAS TC WV CII PUIG itis cnnaae cide tucainsetaalet Getagivcea xalebeed snundsauiutehducseanitedeaideundaondcedensadhauauacideteitntey 15 
Exhibit A1. Variation in Intensity Levels Across the EPPs by Essential Components of the 
IC RAGING RUD IC sas siuscsacacssustedtacdepasde na tacasundevaviaawqiidashd soacdasaqatnceactouaasdvancetedanndaaiiuaes elusdamencarsaadaaeee 20 
Exhibit A2. Variation in Intensity Levels Across the EPPs by Essential Components of the 
TO VV PIR WA RUNG cas cusanhesactsuntadesacnaiedd oncadecayacwiwtaadigtcvastaxsania say sbaceaneuuasim aacdecadaadacivaraensancavantacaedaaeee 20 
Exhibit A3. Number of Courses Covering Essential Components of the IC Reading and 
MU TCHS PR IPC Sas ac siendanaaaisssaccantcaindacsvaqatauhasanattaanecnasuasoagaxsadadusandesuaaecangacieasamaecerenaduasdauentacugaivaand 21 


CONETWORK YY) Sm sectanri 


Comprehensive Center Network Massachusetts Vermont 


Findings From the Massachusetts Educator Preparation Program Core Course Review 


Executive Summary 


In 2019, the Massachusetts Department of Elementary and Secondary Education (DESE) 
released a Literacy Strategic Plan that lays out a vision for “[a]n excellent education in English 
language arts (ELA) and literacy for all students in Massachusetts” (DESE, 2019a). In support of 
achieving the goals outlined in the strategic plan, DESE seeks to better understand the current 
landscape of educator preparation programs in Massachusetts and the extent to which they are 
currently preparing teachers to use evidence-based? ELA instructional practices in order to 
engage the educator preparation field in advancing toward the state’s goals. As part of this 
landscape review, DESE requested the Region 1 Comprehensive Center (R1CC) to conduct a 
statewide needs assessment focused on the preparation of teacher candidates in K—3 literacy 
instruction. To do so, R1CC reviewed 64 syllabi from a voluntary sample of nine educator 
preparation programs (EPPs) for their early childhood and elementary certification pathways, 
representing more than 30% of Massachusetts’ recent graduates/program completers. The 
syllabi were reviewed using two of the Collaboration for Effective Educator Development, 
Accountability and Reform (CEEDAR) Center’s Innovation Configurations (ICs) rubrics: Evidence- 
Based Reading Instruction (Lane, 2014) and Evidence-Based Practices for Writing Instruction 


(Troia, 2014). 


R1CC found that many of the volunteer EPPs participating in this review offered reading and 
writing courses whose syllabi contained evidence of the 10 Essential Components identified by 
the CEEDAR Center’s IC rubrics. In addition, findings from these nine EPPs include the following: 


e The syllabi from six of the EPPs presented all 10 of the IC Essential Components for 
evidence-based reading instruction. 


e Syllabi from three of the EPPs did not cover two key reading components: decoding and 
phonemic awareness. These are foundational skills that are necessary for students to learn 
to read (Foorman et al., 2016). Phonemic awareness, the capacity to detect and manipulate 
individual phonemes or sounds within words, and decoding—the ability to translate a word 
from print to speech—are powerful predictors of later reading success (Foorman et al., 
2016; Lane, 2014). 


1 Evidence-based practices have evidence from formal studies and research to show that they are effective at producing results 
and improving outcomes when implemented as described in the Every Student Succeeds Act (ESSA) 
(https://ies.ed.gov/ncee/wwc/essa). A recent report from the Council of Chief State School Officers (CCSSO) connects educator 
preparation programs to reading instruction provided to students and describes how educator preparation programs can 
improve teachers’ use of evidence-based literacy practices (CCSSO, 2021). 
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e Coverage of the IC Essential Components for Writing (Troia, 2014) was less prevalent in the 
syllabi than coverage of the reading components. The syllabi from eight of the nine EPPs 
presented just two of the 10 IC Essential Components of evidence-based writing instruction. 
Writing is a critical skill that predicts success in school and the workplace and allows 
students to demonstrate, support, and deepen their knowledge and understanding of 
themselves, their relationships, and their worlds (Shanahan, 2009; Sperling & Freedman, 
2001; Troia, 2014). 


The findings from this syllabi review are preliminary and based on information found in syllabi 
from a sample of nine EPPs that volunteered to participate in the review. Though this kind of 
review has inherent limitations, the results provide early insights. RLCC recommends that 
future reviews include additional data such as course schedules, calendars, and, if possible, 
observations of EPP courses and field-based experiences to learn about preservice teachers’ 
opportunities to apply what they learn in their courses, practice skills, and receive explicit 
feedback on their application of skills. A future review may include training faculty on ways to 
strengthen programs to ensure preservice teachers have multiple opportunities in classroom 
settings and with students to apply, practice, and receive feedback on evidence-based reading 
and writing instructional practices. 
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Introduction 


In 2019, the Massachusetts Department of Elementary and Secondary Education (DESE) 
released a Literacy Strategic Plan, which lays out a vision for “[a]n excellent education in English 
language arts (ELA) and literacy for all students in Massachusetts” (DESE, 2019a). DESE’s priority 
of delivering an excellent ELA/literacy education for every child in the state is informed by the 
need for all students to develop a strong foundation in literacy. Only 56% of Massachusetts 
third-graders in 2019 met proficiency targets for ELA (DESE, 2019b). This statistic reflects not 
student effort or ability, but opportunity and support to learn. Massachusetts consistently leads 
the United States and the world on national and international assessments of literacy, but 
Black, Latinx, and low-income students in Massachusetts schools continue to have dramatically 
different experiences than their White and higher income peers. Massachusetts schools 
support only 29% of Black and Latinx students to achieve proficient levels in reading, which is 
less than half the achievement level of White students.” To achieve equity, every student must 
receive the high-quality curriculum and evidence-based instruction they need and are entitled 
to receive. Thus, DESE’s Literacy Strategic Plan identifies two areas of focus for the instructional 
support for ELA and literacy: high-quality core instruction and use of evidence-based practices 
for early literacy skills. 


DESE’s focus on educator preparation is part of this comprehensive Literacy Strategic Plan to 
build instructional knowledge and skill in evidence-based practices among educators from 
novice through experienced levels. Anecdotal evidence in Massachusetts aligns with national 
studies suggesting that all preparation programs do not consistently teach evidence-based 
practices for early literacy.? This review is designed to provide greater insight into the current 
educator preparation landscape in Massachusetts. 


DESE requested that the Region 1 Comprehensive Center (R1CC) conduct a statewide needs 
assessment focused on educator preparation in K—3 literacy instruction and educator 
implementation of evidence-based literacy practices in K—-3 classrooms. The needs assessment 
comprises the following: 


1. Areview of syllabi from courses required for an early childhood and elementary 
certification (EPP Core Course Review) 


2. A survey of educators’ current curriculum, instruction, and strategies used in Massachusetts 
elementary schools 


? https://www.nationsreportcard.gov/reading 2017/states/gaps?grade=4 


3 https://www.doe.mass.edu/instruction/literacy-plan.docx, p. 15. 
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This report discusses part one of the two-part needs assessment: the methods and findings 
from the EPP Core Course Review. These findings will be used to inform DESE’s decisions 
related to policy and supports to strive toward its vision of an excellent education in 
ELA/literacy for all its students. 


Educator Preparation Program Course Review 
Objectives and Questions 


The purpose of the EPP Core Course Review is to review the extent to which EPP syllabi provide 
evidence that these programs are preparing preservice teachers and providing them with 
opportunities to practice evidence-based reading and writing instruction. The review focused on 
syllabi of core courses from a sample of Massachusetts EPPs. These courses are required for 
individuals pursuing certification in early childhood (prekindergarten—Grade 2) or elementary 
(Grades 1-6). Using CEEDAR Center’s Innovation Configurations (ICs), a group of trained 
reviewers examined content in syllabi provided to R1CC from a voluntary sample of nine EPPs 
that represent 30% of graduates in early childhood and elementary programs. This review 
addressed the following two questions: 


e To what extent are evidence-based practices in reading and writing instruction represented 
within program syllabi from the participating EPPs? 


e Do syllabi vary in the intensity and levels of practice-based opportunities associated with 
the evidence-based practices in reading and writing instruction? If so, how do they vary? 


Methodology 


The review involved several key activities and processes that are discussed in the sections that 
follow: 


e Identification and recruitment of a sample of EPPs 
e Recruitment of faculty members from EPPs to review syllabi 
e Training of reviewers and calibration across reviewers 


e Systemic review of syllabi 
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Recruitment and Sample 

To elicit the participation of EPPs in the Core Course Review, DESE and R1CC began outreach 
efforts by facilitating a webinar in October 2020 to present the review project to EPPs. EPPs 
were given the opportunity to ask questions and learn about the review process. At the end of 
the webinar, EPPs were asked to contact DESE if they were interested in participating in the 
project. Outreach and recruitment was open for all EPPs in Massachusetts and focused on 
ensuring representation from organizations that prepare teacher candidates across 
Massachusetts, including a range of program sizes, geographic diversity, and public and private 
higher education institutions. DESE staff conducted initial outreach with interested 
organizations and introduced them to the R1CC team members, who then followed up with the 
EPPs to recruit them to participate in the review. 


The final sample of EPPs were based in the South Coast, Worcester, Springfield, and greater 
Boston areas (see Exhibit 1 for a summary description of the EPP sample). The EPPs provided 
syllabi from courses in their early childhood or elementary education certification programs. 
The EPPs selected the program type (baccalaureate or postbaccalaureate), certification 
program to be reviewed, and the syllabi to share with R1CC. All participating EPPs were 
institutions of higher education. In total, the EPPs provided 116 syllabi. Fifty-two syllabi were 
removed from the sample because reviewers could not find any literacy content. These 
excluded syllabi were from mathematics, classroom management, history of the United States, 
child development, and other courses that did not focus on reading and writing instruction. The 
reviewers focused on the remaining 64 syllabi, or 55% of the syllabi received, that included 
literacy content. The average number of syllabi reviewed per EPP was seven. 


Exhibit 1. Characteristics of the Nine Participating EPPs 


Programs Number of Course Syllabi Reviewed 


PROGRAM TYPE 


js cacaawene dS 


CERTIFICATION PROGRAM 


PUBLIC/PRIVATE 
a 
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Review Process 


R1CC leveraged the CEEDAR Center’s IC system to conduct the syllabi review. The Evidence- 


Based Reading Instruction for Grades K—5 (Lane, 2014) and Evidence Based Practices for Writing 


Instruction (Troia, 2014) rubrics were used to analyze the syllabi, as they were well-aligned to the 


Massachusetts literacy standards for elementary education. CEEDAR uses evidence standards to 


identify the essential components for evidence-based practices within the ICs. The IC rubrics 


show not only whether the essential 
components are taught in a program but 
also the extent to which candidates are 
provided practice-based opportunities 
within the classroom environment. 


For the past three decades, ICs have assisted 
with studying change in education (Roy & 
Hord, 2004). Although ICs represent a 
diverse group of tools, they are often utilized 
to provide a way to self-assess and 
determine the level of implementation of a 
specified innovation. The CEEDAR Center 
developed ICs in a variety of content areas. 
Each IC identifies “essential components” 
grounded in evidence-based practices 
identified from the research and literature in 
the specified content area.* 


Five literacy subject matter experts were 
trained by CEEDAR staff to conduct the 
program reviews using the ICs, including two 
faculty members from Massachusetts EPPs. 
R1CC removed identifying information from 
the syllabi before sharing them with the 
reviewers. CEEDAR Center staff hosted a 
follow-up meeting for reviewers to discuss 
their reviews and ensure consistency across 
reviewers. 


Essential Components in the IC Rubrics 

K-5 Reading Instruction 

1. Influences on Reading Policy and Practice in 
the United States 

2. Foundation Concepts About Oral and Written 

Language 

Phonemic Awareness 

Decoding (Instruction and Principles) 

Fluency (Role, Instruction, and Assessment) 

Vocabulary (Types, Role, and Instruction) 

Comprehension (Instruction and Strategies) 

Explicit and Systematic Instruction 


COMIN ANA W 


Organization for Instruction 
10. Literacy Assessment 
(Lane, 2014) 


K-5 Writing Instruction 

Writing Is an Essential Part of the Curriculum 
Varied Approaches to the Teaching of Writing 
Instruction Focused on Process Elements 
Instruction Focused on Product Elements 
Utilizing Technology in Writing Instruction 
Effective Assessment and Feedback for Writing 
Instruction Focused on Writing Skills 

Learning Through Writing 


CO CO ees ee Coa a 


Promoting Independent and Reflective Writers 
10. Promoting a Supportive Writing Environment 
(Troia, 2014) 


4 The process used in this review was different than the process typically used by the CEEDAR Center. The CEEDAR Center uses 
the IC rubrics to self-assess programs on the essential components. The data collected are used to identify strengths and gaps 


of programs and guide reform. 
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Findings From the Massachusetts Educator Preparation Program Core Course Review 


Each participating EPP received a report with the results of a review of their individual program. 
R1CC gave the EPPs an opportunity to discuss their individual program results with the review 
team and share additional context about their program. Of the nine participating EPPs, five met 
with the review team. In the meetings, representatives of the EPPs, who included faculty 
members and program directors, asked the team about the review process, syllabi reviewed, 
and the IC rubrics and components. The representatives expressed their appreciation for their 
individual program review and the opportunity to learn about the strengths and gaps in their 
core course syllabi. The representatives validated the results of the syllabi review. 


Findings 
The EPP Core Course review addressed the following primary research questions: 


e To what extent are evidence-based practices in reading and writing instruction represented 
within program syllabi from the participating EPPs? 


e Dosyllabi vary in the intensity and levels of practice-based opportunities associated with 
the evidence-based practices in reading and writing instruction? If so, how do they vary? 


In the first question, we define representation by the descriptions and words included in the 
syllabi that align to the reading and writing IC rubrics. The words and descriptions come from 
the course objectives and outcomes, activities (in the field and classroom), assignments, 
projects, tests/quizzes, and/or demonstrations. For example, in a syllabus that described a book 
buddy journal activity, we coded the part of the activity that encouraged students’ written 
responses as the “Learning Through Writing” component. 


The findings are organized by research question and content area. The results focused on 
reading instruction are shown first, followed by the results on writing instruction. 
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To what extent are evidence-based practices in reading and writing 
instruction represented within program syllabi from the participating 
EPPs? 


Reading Instruction 

Findings demonstrate that the essential components of evidence-based reading instruction 
were represented in the syllabi provided by the participating EPPs. Six of the nine participating 
EPPs presented all of the essential components for reading instruction as outlined in the IC 
rubric into the syllabi for their program (see Exhibits 2 and 3). However, decoding and 
phonemic awareness were fully absent from syllabi in some programs, which is concerning 
given how critical instruction in decoding and phonemic awareness is for students to learn to 
read (DESE, 2017; Foorman et al., 2016). Instruction on decoding was missing from syllabi 
provided by two EPPs and the syllabi from one EPP lacked instruction focused on phonemic 
awareness. 


Exhibit 2. Essential Components of the IC Reading Rubric Represented in the EPPs’ 
Syllabi 


be] 
8 
6 
5 
i 
ie} 


N 


Number of EPPs 
Ww r— 


N 


1. Influences 2. Foundation 3. Phonemic 4. Decoding 5. Fluency 6. Vocabulary 8. Explicit 9. Organization 10. Literacy 
on Reading Concepts about Awareness eines asics and for Instruction Assessment 
Policy and Oral and Systematic 
Practice in Written Instruction 
the US Language 


IC Reading Components 
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Exhibit 3. Essential Components of the IC Reading Rubric Across the EPPs 


Reading Essential Component EPP 1 | EPP2 | EPP3 | EPP 4 | EPPS | EPP6 | EPP 7 | EPP8 | EPP9 


1. Influences on Reading Policy and 
Practice in the United States 


2. Foundation Concepts About Oral 
and Written Language 


3. Phonemic Awareness 


4. Decoding (Instruction and 
Principles) 


5. Fluency (Role, Instruction, 
Assessment) 


6. Vocabulary (Types, Role, and 
Instruction) 


7. Comprehension (Instruction and 
Strategies) 


The data from the sample of nine EPPs suggest that many essential components of evidence- 
based reading instruction are included in syllabi, and preservice teachers are exposed to the 
components at some level. However, the syllabi from two of the EPPs lacked a focus on 
decoding and one lacked phonemic awareness. 


In addition to analyzing the content in the syllabi to measure the extent to which it aligned with 
the IC reading and writing rubrics, we assessed the degree to which preservice teachers had 
opportunities to both learn and apply the evidence-based practices. Application could involve 
summarizing journal articles, creating lesson plans, modeling evidence-based practices, tutoring 
students, and other activities. Importantly, this review of syllabi is limited to application 
opportunities available in the courses. Programs may offer additional opportunities as part of 
their prepracticum or full practicum experiences; however, that information is not captured in 
this review. The following findings examine the levels of practice-based opportunities aligned 
with the IC reading and writing rubrics. 
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Do syllabi vary in the intensity and levels of practice-based 
opportunities associated with the evidence-based practices in reading 
and writing instruction? If so, how do they vary? 


The IC system considers the degrees in the following levels: 
e Level Zero: There is no evidence that the essential component is present in the syllabus. 


e Level 1: Must contain at least one of the following: reading, test, lecture/presentation, 
discussion, modeling/demonstration, or quiz. 


e Level 2: Must contain at least one item from Level 1, plus at least one of the following: 
observation, project/activity, case study, or lesson plan study. 


e Level 3: Must contain at least one item from Level 1 as well as at least one item from Level 
2, plus at least one of the following: tutoring, small-group student teaching, or whole-group 
internship. 


It is important to note there is no “ideal” activity or intensity level for each EPP. The levels are 
generated as data points to provide information to reflect on strengths and gaps across the 
EPPs’ syllabi. For instance, it may be acceptable for syllabi to have a Level 1 on activities related 
to the “Influences on Reading Policy and Practice in the United States” component. In the case 
of decoding, Level 1 is concerning as teacher candidates need multiple opportunities to practice 
decoding instruction in authentic ways with varying student populations to be confident that 
they can effectively teach students how to decode. 


Most of the EPPs provided at least a Level 1 activity for preservice teachers to learn the 
essential components of the IC reading rubric (see Exhibit 4). For more details on the intensity 
levels across the EPPs by IC reading components, see Exhibit A1 in the appendix. 
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Exhibit 4. Levels of Knowledge Building and Application on the Essential 
Components of the IC Reading Rubric 


ioe of EPPs 


uw 


b 


1. Influences on 2.Foundation 3. Phonemic 4. Decoding 5. Fluency (Role, 6. Vocabulary 8. Explicitand 9. Organization 10. Literacy 
Reading Policy Concepts about Awareness (Instruction & Instruction, (Types, Role, & Prine cere Systematic forlnstruction Assessment 
and Practice in Oral and Written Principles) Assessment) Instruction) (Instruction & Instruction 

the US Language Strategies) 


Intensity Levels 


@Three @Two mOne Zero 


The findings suggest the following: 


The syllabi from the nine EPPs showed the highest level of intensity in their course activities 
related to the “Organization for Instruction” component. This component focuses on 
selecting appropriate text for instruction, including the role of reading level, complexity, 
genre, and interest; grouping for reading instruction (e.g., ability grouping, flexible 
grouping); planning for instructional intensity, including amount of teacher regulation of 
learning, group size, instructional time allotment, and opportunities to respond; and 
managing multi-tiered system of supports (Lane, 2014). 


The syllabi from eight EPPs showed the highest level of intensity in their course activities in 
“Foundation Concepts About Oral and Written Language” and “Explicit and Systematic 
Instruction.” The “Foundation Concepts” component includes practices related to the 
structure of the English language, orthography, morphology, syntax, theories about reading, 
and other concepts (Lane, 2014). “Explicit and Systematic Instruction” focuses on direct 
instruction, modeling, providing examples, and other instructional practices. 
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The syllabi from three EPPs offered either no activities focused on the “Decoding” 
component or a Level 1 activity. One EPP did not have any syllabi that included “Phonemic 
Awareness,” and one EPP had syllabi with a Level 1 activity on that component. This shows 
the teacher candidates in those courses had limited or no exposure to evidence-based 
practices in decoding and/or phonemic awareness. 


Syllabi had a limited number of Level 3 activities involving the “Vocabulary” and 
“Comprehension” components. Research shows that vocabulary occupies an important 
middle ground in learning to read and is crucial to the comprehension processes of a skilled 
reader (National Reading Panel & National Institute of Child Health and Human 
Development, 2000). Reading comprehension, “the process of simultaneously extracting 
and constructing meaning through interaction and involvement with written language” 
(Snow, 2002, p. 11), is central to students’ academic and professional success (Shanahan et 
al., 2010). 


Writing Instruction 

Among the participating EPPs, the essential components of writing instruction were 
represented in half of the syllabi provided. Eight of the nine EPPs presented two of the 10 
essential components for evidence-based writing instruction: “Writing is an Essential Part of the 
Curriculum” and “Learning Through Writing” (see Exhibits 5 and 6). 


Exhibit 5. Essential Components of the IC Writing Rubric Represented in the EPPs’ 
Syllabi 


Number of EPPs 


9 
8 


7 


6 
5 
4 
3 
2 
1 


fe) 
1.Writingisan 2. Varied 3. Instruction 4.Instruction 5. Utilizing 6. Effective 7.Instruction 8.Learning 9.Promoting 10. Promoting 


Essential Part Approachesto Focused on Focusedon Technologyin Assessment & Focused on through Independent & a Supportive 
of the the Teaching of Process Product Writing Feedback for Writing Skills Writing Reflective Writing 
Curriculum Writing Elements Elements Instruction Writing Writers Environment 


IC Writing Components 
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Exhibit 6. Essential Components of the IC Writing Rubric Across the EPPs 


Writing Essential Component EPP 1 | EPP 2 | EPP3 | EPP 4/| EPP 5| EPP6 | EPP 7 | EPP 8 | EPP9 

ie pelle Is an Essential Part of the V vi y y y v v V 
Curriculum 

2. Varied Approaches to the Teaching of V V ff V V S J V 
Writing 

3. Instruction Focused on Process Y Gi y V y y 
Elements 

4. Instruction Focused on Product V VY VY VY VY 
Elements 


5. Utilizing Technology in Writing 
Instruction 
Effective Assessment and Feedback 
for Writing 


Instruction Focused on Writing Skills re || See Ea 
Learning Through Writing 


Promoting Independent and 
Reflective Writers 

10. Promoting a Supportive Writing # i Y V y 
Environment 


Writing is a critical skill that predicts success in school and the workplace (Troia, 2014). In K-3, 


students compose texts to demonstrate, support, and deepen their knowledge and 
understanding of themselves, their relationships, and their worlds (Shanahan, 2009; Sperling & 
Freedman, 2001). Key findings are listed as follows. 


e None of the syllabi showed evidence of one component: “Utilizing Technology in Writing 
Instruction.” 


e The syllabi from four EPPs lacked instruction that was “Focused on Product Elements.” This 
critical writing skill component develops from instruction that teachers provide to help 
students understand and use elements that appear in the text and make the text 
pleasurable, informative, and/or provocative for the reader (Olinghouse & Wilson, 2013). 


e The syllabi from four EPPs lacked “Effective Assessment and Feedback for Writing.” To 
improve their writing, students need to practice writing a variety of products, and they need 
effective assessment and ample feedback from teachers and other students to improve 
their writing (Troia, 2014). 
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e Syllabi from six EPPs lacked evidence of the following components: 


— “Writing as an Essential Part of the Curriculum,” which includes practices related to the 
time devoted daily to explicit writing instruction and practice, and time for students to 
do free writing. 


— “Varied Approaches to the Teaching of Writing,” which include instruction in process 
and strategy, as well as comprehensive instruction. 


— “Learning Through Writing,” which involves instructional practices that help students 
use textual and other sources of information as content for writing and to use writing as 
a means of deepening content and literary knowledge. 


These findings align with national research that suggests EPPs may not be exposing teachers to 
evidence-based practices in writing instruction as adequately as reading instruction (Baggott, 
2012). Across the country, teachers have reported feeling less prepared to teach writing and, as 
a result, report spending less time teaching essential writing skills as compared to reading skills 
(Baggott, 2012). 


In terms of the activities and intensity levels, there was more variation in the intensity levels 
across the essential components of the IC writing rubric compared to the IC reading rubric (see 
Exhibit 7; for more details on the intensity levels across the EPPs by IC writing components, see 
Exhibit A2 in the appendix). Few Level 2 and Level 3 writing activities were noted in the syllabi, 
which is concerning because preservice teachers need opportunities to apply what they learn 
by doing more intensive coursework such as projects, case studies, or lesson plan studies or 
have fieldwork experiences with students such as tutoring, small-group student teaching, or 
whole-group internship. In addition, we found the following: 


e Only one component, “Writing Is an Essential Part of the Curriculum,” had a high level of 
intense activities compared to the other nine components. 


e The components with the lowest levels of intensity were “Effective Assessment and 
Feedback for Writing” and “Instruction Focused on Product Elements.” In addition, the few 
courses that focused on these two components used activities that were low intensity and 
may not adequately prepare teachers to teach these two components. 


CONETWORK YY) 2) sect 


Comprehensive Center Network Massachusetts Vermont 14 


Findings From the Massachusetts Educator Preparation Program Core Course Review 


Exhibit 7. Levels of Knowledge Building and Application on the 10 Essential 
Components of the IC Writing Rubric 
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Information from the syllabi suggests minimal opportunities for preservice teachers to apply 
what they have learned about writing instruction. Research shows that preservice teachers 
need opportunities to practice with feedback in order to be prepared to teach evidence-based 
literacy practices (National Council on Teacher Quality, 2020; Salinger et al., 2010). See Exhibit 
A3 in the appendix for the results of an additional analysis we performed examining the 
number of courses that covered the essential components of evidence-based reading and 


writing instruction. 
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Conclusions 


As evidenced in the syllabi of the participating EPPs, the results from the EPP Core Course 
Review suggest that many of them include evidence-based reading instructional practices 
within their programs. The majority of the participating EPPs’ syllabi addressed all of the 
essential components of the IC reading rubric. However, some of the syllabi lacked instruction 
focused on phonemic awareness, decoding, and, to a lesser degree, vocabulary and 
comprehension. Additionally, syllabi from some of the EPPs showed limited opportunities for 
preservice teachers to apply what they learned, especially in decoding and phonemic 
awareness. In particular, the level of application that included feedback on teaching decoding 
was lower than the other reading components. Teacher candidates need multiple opportunities 
to practice in order to become expert practitioners. Decoding and phonemic awareness are 
foundational skills that are critical to students learning to read. It is imperative that preservice 
teachers learn how to teach students decoding and phonemic awareness. 


The findings on writing instruction echo other research (Troia & Graham, 2003) demonstrating 
that teachers may not be adequately prepared to teach writing and therefore struggle with 
teaching students to write. The syllabi did not show evidence of incorporating all essential 
components of the IC writing rubric. In particular, there was either no coverage of certain 
components or limited coverage or few activities that were highly intensive. This review 
suggests EPPs need to provide more opportunities for preservice teachers to apply what they 
have learned about writing instruction. 


The findings from this EPP Core Course Review are preliminary and based on information found 
in syllabi provided by nine EPPs that volunteered to participate in this syllabi review. The 
findings may not be entirely generalizable across all EPPs in the state. In addition, the review 
focused only on syllabi that may vary in terms of detail and consistency within and across EPPs. 
Because syllabi were the main source of information, it is not possible to know the depth or 
accuracy of coverage of the components of the IC Reading and Writing rubrics as taught and 
practiced in preparation classrooms. 


Though this kind of review has inherent limitations, the results may be valuable to set the stage 
for a more comprehensive review involving additional EPPs that would provide important 
insight into programmatic design. RLCC recommends that future reviews collect more data 
such as course schedules, calendars, and, if possible, observations of EPP courses and field- 
based experiences to learn how and if preservice teachers have opportunities to practice skills 
and receive explicit feedback on their application through practice. 
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Appendix 


Exhibits A1 and A2 show the breakdown of intensity levels across the EPPs by essential 
component. 


Exhibit A1. Variation in Intensity Levels Across the EPPs by Essential Components of 
the IC Reading Rubric 


Intensity Level 


Explicit and Systematic Instruction | oo | 
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10. Literacy Assessment | oo | 


Exhibit AZ. Variation in Intensity Levels Across the EPPs by Essential Components of 
the IC Writing Rubric 
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Exhibit A3 provides an overview of how many courses in each EPP showed evidence of an 
essential component. 
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Exhibit A3. Number of Courses Covering Essential Components of the IC Reading and 
Writing Rubrics 


Reading Essential Component EPP 1 | EPP 2| EPP3 | EPP 4/| EPP 5| EPP6| EPP 7 | EPP 8 | EPP 9 
Influences on Reading Policy and Practice in 3 1 3 1 1 2 3 1 2 
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